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pre-service mathematics version of the “California Critical Thinking Dispositions Inventory” 
teacher, critical thinking (CCTDD). The scale has six subscales (Open-mindedness, inquisitiveness, 


systematicity, truth seeking, analyticity, and self-confidence). The results 
revealed that the majority of students had moderate critical thinking 
disposition. Strong positive relationships among all six subscales were 
determined. Further, there were significant differences in students’ critical 
thinking disposition based on gender and grade level. 


Introduction 

In today’s vastly changing world, many organizations such as The Partnership for 21st 
Century Skills (P21) have advocated that the key performance outcomes around which curricula 
and assessments should be focused are critical thinking, reasoning, communication and 
media/information/technology literacy in mathematics. Thus, students will need to take into 
account both the core academic knowledge and the higher order thinking skills to be successful 
in college, life and career (Partnership for 21st Century Skills, 2011). 


According to Yang, Chuang, Li, and Tseng (2014), critical thinking is one of the most important 
keys of the 21st century higher order thinking abilities and is a significant component of 
education (Browne & Litwin 1987; Kong et al., 2014; Moore, 2013; Sendag & Odabasi, 2009; 
Yeh, 2012). 


Researchers have described critical thinking (CT) as “the ability to engage in purposeful, self- 
regulatory judgment” (Abrami et al., 2008), “reflective decision-making and thoughtful 
problem solving about what to believe and do thinking” (Ennis, 1987), “cognitive skills or 
strategies that increase the probability of a desirable outcome” (Halpern, 2003), and “the 
educational cognate of rationality” (Siegel, 1998). 


One of the most important contributions on conceptualization of CT is done through “The 
American Philosophical Association Delphi Project” (Facione, Giancarlo, Facione, & Gainen, 
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1995). According to this project, critical thinking for educational purposes includes both 
cognitive skills and dispositions (Facione, 1990). Critical thinking disposition which is 
characterized as a “probing inquisitiveness, a keenness of mind, a zealous dedication to reason, 
and a hunger or eagerness for reliable information” includes seven sub-dispositions: open- 
mindedness, inquisitiveness, systematicity, truth-seeking, analyticity, CT self-confidence, and 
cognitive maturity (Facione, 1990). Table | displays the definitions of these dispositions. 


Table 1. Definition of elements of critical thinking dispositions (Facione, Giancarlo, Facione, 
& Gainen, 1995). 


Factor Description 

Open-mindedness being tolerant to divergent views and sensitive to the possibility of one's own bias. 

Inquisitiveness intellectual curiosity and eagerness for learning even when the application of the knowledge is 
not readily apparent. 

Systematicity being organized, orderly, focused, and diligent in inquiry. 

Truth-seeking disposition of being eager to seek the best knowledge in a given context, courageous about asking 


questions, and honest and objective about pursuing inquiry even if the findings do not support 
one's self-interests or one's preconceived opinions. 


Analyticity prizing the application of reasoning and the use of evidence to resolve problems, anticipating 
potential conceptual or practical difficulties, and consistently being alert to the need to intervene. 

Self-Confidence to trust the soundness of one's own reasoned judgments and to lead others in the rational 
resolution of problems 

Maturity being judicious in one's decision-making 


Over the past decade, a lot of research has investigated the importance of critical thinking 
dispositions (CTD) (Bell & Loon, 2015; Lewis, 2012; Naber & Wyatt, 2014; Ojewole, 2013; 
Racchini, 2007; Walter, 2013; Yang, Chuang, Li, & Tseng, 2014). Researchers have reported 
that CTD are significant because they are a pre-requisite to the development of powerful critical 
thinking skills (Beyer, 1987; Ojewole, 2013). According to Kuhn (1999), a learners’ disposition 
to think critically is a factor that should be examined with caution, since it leaves a lot of 
unaccounted variance. Studies point out that age, maturity, education and educational 
curriculum are important (Cohen, 2010; Lane-Patrice, 2013; Lewis, 2012). It has been also 
proposed that gender and previous experience may be two of the factors that affect students’ 
CT development. Ojewole (2013) believe that experience may affect the CTD, since CT is 
thought to have a chronological developmental component. Studies have reported statistically 
significant (Huang & Yeh, 2010; Lane-Patrice, 2013) and insignificant differences (Lewis, 
2012) between the CTD and experience. King, Wood and Mines (1990) found that the rate of 
critical thinking development among males majoring in social and mathematical science is 
higher than the rate for females. Others (Burbach, Matkin, Quinn, & Searle, 2012; Cohen, 2010) 
believe that gender may not influence CT skills or dispositions. It is inconclusive whether or 
not experience and gender have any influence on a students’ CT development. Therefore, it is 
important to explore gender and experience differences on students’ CTD. 


Research related to CTD has grown rapidly in Turkey (Akgiin & Duruk, 2016; Bakir, 2015; 
Besoluk & Onder, 2010; Cetinkaya, 2011; Kékdemir, 2003; Tiimkaya, 2011; Yenice, 2011). 
Regarding pre-service teachers’ CTD, researchers have reported that the CTD levels of the pre- 
service teachers are low (Bakir, 2015; Cetinkaya, 2011, Incikabi, Tuna, & Biber, 2013) and 
medium (e.g., Cevik, 2013; Sen, 2009). Based on the analysis of demographic features of pre- 
service teachers, the findings show that there is significant difference according to gender 
(Cetinkaya, 2011, Tiimkaya, 2011; Yenice, 2011), age (Cubukcu, 2006; Kiiriim, 2002) and 
grade (Cetinkaya, 2011; Zayif, 2008). In summary, previous research suggests that pre-service 
teachers’ CTD levels are low and medium and that there are significant and insignificant 
differences according to gender, age and grade. 
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Although CTD literature has grown, there are little evidence that look at the CTD of the pre- 
service mathematics teachers charged with developing CT skills and dispositions in students 
(Cevik, 2013; Incikabi, Tuna, & Biber, 2013; Yiksel, Uzun, & Dost, 2013). Thus, the purpose 
of the current study was to investigate pre-service mathematics teachers’ CTD. Following 
research questions were attempted to answer in this study: 

1. What are the CTD of pre-service mathematics teachers? 

2. Are there the differences in the six factors that measure pre-service mathematics 
teachers’ CTD based on demographic variables: gender and grade level? 

3. Are there relationships among the six factors measured by The California Critical 
Thinking Disposition Inventory (CCTDI)? 

Methodology 

A descriptive research design was used to investigate pre-service mathematics teachers’ 
CTD. Survey research model was used for collecting data in the study. A total of 202 pre- 
service mathematics teacher consisted of the sampling of the study. Participants were students 
in the department of mathematics education at a university in Turkey during spring term of 
2014-2015 academic years. 

Data sources 
The California Critical Thinking Disposition Inventory (CCTDI) 

The original CCTDI developed by Facione and Facione (1992) is composed of 75 items, 
covering seven dimensions. The Turkish version of the CCTDI, which was modified to Turkish 
context by Ké6kdemir (2003) has been administered to measure the dispositions of an individual 
to solve problems and make decisions through critical thinking. The modified instrument was 
reduced to 51 items with 6-point Likert scale ranging from 1 (not true) to 6 (completely true) 
in the item-total correlation analysis 6 subscales: open-mindedness (12 items), inquisitiveness 
(8 items), systematicity (6 items), truth seeking (7 items), analyticity (11 items), and self- 
confidence (7 items). The reported alpha reliability of the overall CCTDI is .88 (K6kdemir, 
2003). 

Demographic Survey 

The demographic survey included biographical information such as gender, age and 
grade level. The Turkish version of the CCTDI and demographic survey were administered to 
all pre-service mathematics teachers during the first week spring term of 2014-2015 academic 
years to be used in measuring CTD. 

Data analysis 

The data analysis was carried out using descriptive statistics, independent samples t-test 
and analysis of variance. The descriptive statistics were used to see demographics of the students 
and general picture of subscales scores. an independent t test was used to investigate mean 
differences between males and females on all six subscales. An analysis of variance was used 
to find out pre-service teachers’ dispositions compared with their level of education. The 
Pearson correlation test was used to examine the relationships among the six factors measured 
by the CCTDI. 

Results 
Demographics 

202 students joined in the study. After the data collection stage, 14 cases with missing 
data were removed from the data. The examination of the data exposed eighteen outliers that 
were removed. 89 out of 170 of the respondents were female. The sample included 1. year (17.3 
%), 2. year(20.8 %), 3. year(23.0 %), 4. year(17.9 %) and 5. year (21.0 %) students. 
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Research question I 

The Turkish version of the CCTDI is scored by summing the items, and dividing the 
total by the number of items and multiplying by ten. Therefore the minimum and maximum 
scores are 60 and 360 since it has six subscales. The overall mean score of students ranged from 
127 to 342 (M = 267.5). According to K6kdemir (2003), a score between 240 to 300 indicates 
a positive CTD. Therefore, total scores show that pre-service mathematics teachers have 
moderate CTD. 


Table 2 shows means and standard deviations for each CCTDI subscale. The highest mean 
scores were obtained by the analyticity subscale (M = 5.02) and the inquisitiveness subscale 
(M = 4.67). The lowest mean value was yielded by the truth-seeking subscale (M = 3.32). (See 
Table 2) 


Table 2. Descriptive statistics of CTD of pre-service mathematics teachers. 


CCTDI scales M SD 
Open-mindedness 3.90 77 
Inquisitiveness 4.67 .68 
Systematicity 4.18 .68 
Truth-seeking 3.32 91 
Analyticity 5.02 .50 
Self-Confidence 4.32 .80 


Table 3 shows the mean scores of pre-service mathematics teachers for items on open- 
mindedness subscale. The highest mean score corresponds to item 7 which states that the tests 
that require thinking, not just memorization, were better for them. More than 75 % of students 
thought that this statement was mostly true, true or completely true. Over 70 % of the 
respondents disagreed with item 18 and 71.1. % disagreed with item 47. (See Table 3) 


Table 3. Descriptive statistics of the open-mindedness subscale of pre-service mathematics 


teachers. 

No Item M SD 
5 If there were four reasons in favor and one against. I'd go with the four. 3.40 1.50 
7 Tests that require thinking, not just memorization, are better for me. 4.95 1.25 
15 Being open-minded means you don't know what's true and what's not. 3.89 1.73 
18 Reading is something I avoid, if possible. 4.50 1.65 
22 Foreigners should study our culture instead of us always trying to 

understand theirs. 3.65 1.68 
33 I look for facts that support my views, not facts that disagree. 2.50 1.48 
36 Analogies are about as useful as a sailboat on a freeway. 3.61 1.68 
41 My opinion about controversial topics depends a lot on who I talk to last. 3.74 1.66 
43 The best way to solve problems is to ask someone else for the answers. 4.22 1.71 
45 Being open-minded about different world views is less important than 

people think. 3.75 1.75 
47 Things are as they appear to be 4.45 1.76 
50 Others are entitled to their opinions, but I don't need to hear them 4.21 1.69 


Table 4 shows the mean scores of pre-service mathematics teachers for items on inquisitiveness 
subscale. Over 70 % of students answered it was mostly true, true or completely true that they 
enjoyed trying to figure out how things work (item 38). Over 60 % of students agreed with 
items 1, 30, 32 and 42. (See Table 4) 
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Table 4. Descriptive statistics of the inquisitiveness subscale of pre-service mathematics 


teachers. 

No Item M SD 

Studying new things all my life would be wonderful 4.71 1.12 
8 Others admire my intellectual curiosity and inquisitiveness. 4.19 1.39 
30 I look forward to learning challenging things. 4.88 1.09 
31 It makes a lot of sense to study what foreigners think. 4.37 1.43 
32 Being inquisitive is one of my strong points. 4.72 1.30 
34 Complex problems are fun to try to figure out. 4.60 1.29 
38 I really enjoy trying to figure out how things work. 5.06 1.08 
42 No matter what the topic, I am eager to know more about it. 4.86 1.18 


Table 5 shows the mean scores of pre-service mathematics teachers for items on systematicity 
subscale. One item on the subscale had a mean score above 5.0. More than 75 % of students 
answered it was mostly true, true or completely true that they were proud that they can think 
with great precision. Over 70 % of students thought that it was easy for them to organize their 
thoughts. Over 70 % of the respondents disagreed with item 9. (See Table 5) 


Table 5. Descriptive statistics of the systematicity subscale of pre-service mathematics 


teachers. 
No Item M SD 
4 I'm proud that I can think with great precision. 5.09 .96 
9 I pretend to be logical, but I'm not. 4.88 1.49 
10 It's easy for me to organize my thoughts. 4.63 1.12 
19 People say I rush into decisions too quickly. 3.80 1.68 
21 When I have to deal with something really complex, it's panic time. 3.28 1.54 
23 People -think I procrastinate about making decisions. 3.40 1.42 


Table 6 shows the mean scores of pre-service mathematics teachers for items on truth-seeking 
subscale. Only one item had a mean score above 4.0 with 66.2 % of students thinking that the 
statement was mostly true, true or completely true. (See Table 6) 


Table 6. Descriptive statistics of the truth-seeking subscale of pre-service mathematics 


teachers. 

No Item M SD 

6 Most college courses cure uninteresting and not worth taking. 3.29 1.79 
11 Everyone always argues from their own self-interest, including me. 3.26 1.70 
20 Required subjects in college waste time. 3.78 1.82 
25 Being impartial is impossible when I'm discussing my own opinions. 3.04 1.65 
27 I believe what I want to believe. 2.58 1.57 
28 It's just not that important to keep trying to solve difficult problems. 4.24 1.70 
49 I know what I think, so why should I pretend to ponder my choices. 3.05 1.46 


Table 7 shows the mean scores of pre-service mathematics teachers for items on analyticity 
subscale. The majority of students thought that some statements were mostly true, true or 
completely true. The highest mean score corresponds to item 46 which states that learning 
everything they can (93.5 %). Over 75 % of students agreed with items 3, 13, 16, 17 and 26. 
(See Table 7) 
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Table 7. Descriptive statistics of the analyticity subscale of pre-service mathematics teachers. 


No Item M SD 
It bothers me when people rely on weak arguments to defend good ideas. 4.90 1.32 
3 I always focus the question before I attempt to answer it. 5.24 84 
12 It's important for me to keep careful records of my personal finances. 4.48 1.61 
13 When faced with a big decision, I first seek all the information I can. 5.13 97 
16 It's important for me to understand what other people think about things. 5.19 92 
17 I must have grounds for all my beliefs. 5.08 1.03 
24 People need reasons if they are going to disagree with another's opinion. 5.02 1.01 
26 I pride myself on coming up with creative alternatives. 5.25 90 
37 You could describe me as logical. 4.64 1.22 
40 Getting a clear idea about the problem at hand is the first priority. 4.98 1.00 
46 Learn everything you can, you never know when it could come in handy. 5.27 97 


Table 8 shows the mean scores of pre-service mathematics teachers for items on self-confidence 
subscale. Over 80 % agreed they took pride in their ability to understand the opinions of others. 
Only one item had a mean score below 4.0 with 23% of students thinking that the statement 
was mostly true, true or completely true. (See Table 8) 


Table 8. Descriptive statistics of the self-confidence subscale of pre-service mathematics 


teachers 
No Item M SD 
14 My peers call on me to make judgments because I decide things fairly. 4.44 1.22 
29 Others look to me to establish reasonable standards to apply to decisions. 4.22 1.25 
35 I take pride in my ability to understand the opinions of others. 4.72 1.08 
39 Others look to me to keep working on a problem when the going gets tough. 4.34 1.19 
44 I'm known for approaching complex problems in an orderly way. 4.41 1.15 
48 Others look to me to decide when the problem is solved. 3.62 1.31 
51 I'm good at developing orderly plans to address complex problems. 4.51 1.24 


Research question 2 

An independent t-test was used to determine the differences in mean scores of males 
and females. Results indicated that there were significant differences between two groups on 
inquisitiveness (t = -2.16, p =.03). Male students had higher means (M = 4.79, SD = .63) on the 
scale when compared to females (M = 4.56, SD = .71). The 95% confidence intervals for the 
difference in mean between groups was small for inquisitiveness scale. The Bonferroni 
adjustment procedure was used to avoid inflation of Type I error due to multiple testing. The 
level of significance was confirmed on the subscale. 


Additionally, although female students had higher means (M =3.99, SD = .79; M=3.31, SD 
=.95; M= 5.02, SD=.50; M=4.32, SD=.80) on open-mindedness, truth-seeking, analyticity, and 
self-confidence when compared to males (M = 3.82, SD = .74; M =3.65, SD =.86; M =5.00, 
SD =.49; M =4.31, SD =.80), the differences were not significant in these subscales. 


One-way Analysis of Variance (ANOVA) was used to determine the different effects of 
students’ grade level on each subscale. Results showed that there were significant differences 
between two groups on the self-confidence subscale, F(3,166) = 3.40, p = .01. The results of 
post hoc comparisons confirmed a significant difference in the mean scores of first year (M = 
4.59, SD =.83) and fourth year students (M = 4.14, SD=.68) on this subscale. 
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Research question 3 


The relationships among the six factors measured by the CCTDI were analysed by 
using Pearson correlation test. The results are presented in Table 10. It indicates the correlations 
among all six subscales; all are statistically significant. According to the results, the relationship 
between the self-confidence and inquisitiveness subscales was found the highest correlation (r 
=.551, p =.00) and the relationship between the analyticity and truth-seeking subscales was 
found the lowest correlation (r =.330, p =.00). 


Table 10. Intercorrelations between the six subscales. 


Subscales 1 2 3 4 5 6 
1.Open-mindedness - - - Z s - 
2.Inquisitiveness 525* - - < 7 _ 
3.Systematicity 3837* 359% - = = - 
4.Truth-seeking 541 ** 433 Al5** - - - 
5.Analyticity 342 31 391* 380 - - 
6.Self-confidence A94*% 1 330** J 10** LL - 


Note. *Correlation is significant at the .05 level (2-tailed). 
**Correlation is significant at the .01 level (2-tailed). 
1~6: Subscales of CCTDI 


Discussion, implications, and limitations 

The study indicated that the CCTDI total scores of students ranged from 127 to 342 
(M = 267.5). If the total score is between 240 to 300, the CTD level of participants are medium 
level (K6kdemir, 2003). Therefore, the pre-service mathematics teachers in this study had 
moderate CTD. The findings are consistent with those by Cevik (2013) and Sen (2009). They 
were in either partially or fully disagreement with the findings of Akgiin and Duruk (2016), 
Besoluk and Onder (2010), Cetinkaya (2011), Tiimkaya (2011). Besoluk and Onder (2010), for 
example, found that the majority of pre-service students (68.0%) have medium CTD scores but 
26.7% of pre-service students have low CTD scores (less than 240). 


Regarding subscale scores, the analyticity (M = 5.02) and inquisitiveness (M = 4.67) subscales 
received the highest ratings of the six subscales. It is noticeable that seven items on the 
analyticity subscale had a mean greater than 5.0 and six items on inquisitiveness scale exceeded 
a mean score of 4.5. As can be seen clearly, the pre-service mathematics teachers have 
tendencies on reasoning, questioning, prediction potential difficulties. Also they may have 
intellectual curiosity and eagerness for learning. Tiimkaya (2011) and Kartal (2012) reported 
similar results in their research. Kartal (2012), for example, found that the highest scores were 
analyticity and inquisitiveness subscales. On the other hand the highest score in other research 
was found self-confidence (Cevik, 2013) and open-mindedness subscales (Cetinkaya 2011; 
Ytksel, Uzun, & Dost, 2013). 


Based on self-confidence (M= 4.32) and systematicity (M= 4.18) subscale scores, pre-service 
students were moderately confident and systematic. Six out of seven items on the self- 
confidence scale, for example, exceeded a mean score of 4.0. The findings indicated that the 
pre-service students may be able to trust themselves to make good judgements, successfully 
tackle problems and lead others in the logical solution of problems. In addition, they may 
improve organizational skills. 
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On the other hand, the open-mindedness (M = 3.90) and truth seeking (M= 3.32) subscale 
received the lowest ratings of the six subscales. It is important to note that the highest item 
among these subscales that was item 7 with mean score M= 4.95. Students thought that the tests 
that require thinking are better for them. Profetto-McGrath (2003) states that the reason for the 
low truth-seeking score is that many students may assume a passive posture and refuse to 
analyze new knowledge during lectures. According to Walter (2013), educators should avoid a 
didactic-oriented curriculum that is mainly a lecture style class and use a more problem based 
learning format. 


Another result of the current study was that students’ grade level influenced their levels of CTD. 
First year students felt more self-confident than fourth year students. The findings are consistent 
with the results of Cetinkaya (2011). However Akgiin and Duruk (2016), Bakir (2015) and 
Tiimkaya (2011) have different results in their research. Tiimkaya (2011), for example, found 
that seniors’ scores are significantly higher than the freshman’s on the self-confidence subscales 
scores. On the other hand, Akgtin and Duruk (2016) concluded that there was not a significant 
relationship between gender, grade, and school variables with CTD. 


This study also indicated that gender differences had an effect on inquisitiveness subscales. 
Male students’ scores are significantly higher than the female’s on this subscales scores. Similar 
results were also evident in the literature (Zayif, 2008). Cetinkaya (2011), however, reported 
that female students are significantly higher than male students on the analyticity, open- 
mindedness and truth-seeking subscales scores. Yenice (2011) also found that pre-service 
science teachers’ critical thinking disposition levels show significant difference based on 
gender in favor of female students in open mindedness subscale. 


This study is limited with the participants in the study come from only one educational 
institution. Therefore, results may not generalize well to other institutions. Another limitation 
is that participants self-reported. The fact that the data is self-reported makes the responses 
subjective. 


Conclusion 


Critical thinking is an essential component of 21st century higher order thinking abilities 
and disposition to think critically required for critical thinking and support the critical thinking 
process (Beyer, 1987; Facione, 1998). Thus, improving strong critical thinking disposition 
strategies should be a high priority (Cubukcu, 2006). The purpose of the present study was to 
investigate pre-service mathematics teachers’ CTD. The findings indicated that the pre-service 
mathematics teachers have medium CTD levels. The results suggest that students were 
generally analytic (M = 5.02), inquisitive (M = 4.67), self-confident (M= 4.32) and systematic 
(M= 4.18). Students were moderately open-minded (M = 3.90) and truth seeking (M= 3.32). In 
addition, individual differences such as gender and grade can affect student CTD. 


Given the findings in this study, students should be encouraged to enhance open-mindedness 
and truth-seeking dispositions. According to Ojevole (2013), developing open-mindedness 
disposition can be achieved by creating time for students to reflect upon their experience, 
promoting dialogue, and inquiring about actions. In addition, educators should integrate 
problem based activities in their lectures that can develop truth-seeking disposition. Cohen 
(2010) suggested that encouraging students to question personal biases and opinions that differ 
from others can promote this disposition. 
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Although the study will contribute to the current knowledge base, CTD of pre-service 
mathematics teachers have yet to be explored. According to the results, further studies can 
design qualitatively and critical thinking development in the class can be probed. Research on 
individual differences has so far produced mixed results, so more research is required to 
determine under which conditions these differences occur. Additionally, it is recommended for 
future studies to investigate possible relationships between the individual differences and CTD, 
which would provide opportunities for further exploration. Researchers should investigate 
further to better understand the factors that may enhance development of critical thinking 
among pre-service mathematics teachers. 
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